Papers by David M. Howcroft
OTTers: One-turn Topic Transitions for Open-Domain Dialogue (2021.acl-long)
Copied to clipboard
| Challenge: | a mixed-initiative dialogue system is often purely responsive, make abrupt transitions, or fail to take initiative. |
| Approach: | They propose a task to generate a "bridging" utterance connecting a new topic to the previous conversation turn. |
| Outcome: | The proposed task generates a "bridging" utterance connecting a new topic to the previous topic. |
What happens if you treat ordinal ratings as interval data? Human evaluations in NLP are even more under-powered than you think (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies have shown that human evaluations in NLP are under-powered because of two common factors: they treat ordinal data as interval data and operate under high variance settings. |
| Approach: | They propose to use ordinal mixed effects models to detect small differences between models, especially in high variance settings common in NLP evaluations of generated texts. |
| Outcome: | The proposed models detect small differences in high variance settings, especially in high-variance evaluations of generated texts. |